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DETAILED ACTION 

1. This communication is responsive to Applicant's Amendment, filed on July 19, 
2007. 

2. Claims 1-83 are pending in this application. Claims 1, 12, 22, 31, 42, 52, 61, 69, 
and 78 are independent claims. In the Amendment filed on July 19, 2007, claims 1 and 
12 were amended. This office action is made non-final. 

3. In light of amendments made to claims 1 and 1 2, rejection of claims 1 -4 and 1 2- 
15 under 35 U.S.C. 101 in the prior office action is hereby withdrawn. 

Response to Arguments 

4. Applicant's arguments filed on July 19, 2007 have been considered but are moot 
in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 101 

5. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition 
of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

6. Claims 61-83 are rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. 

Claims 61 , 69, and 78 all recite in lines 1-2 "a computer program product stored 
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on a computer-readable medium". However, the specification of the claimed invention 
fails to define what "computer-readable medium" means. As such, said limitation 
"computer-readable medium" is given the given the broadest interpretation to mean 
computer-readable media described in Paragraph 0036 of the Specification of the 
instant application (U.S. Patent Application Publication Number 20040205041), wherein 
wireless network and wireless signals are described. Wireless signals are not statutory. 
Therefore, claims 61 , 69, and 78 are all rejected 35 U.S.C. 101 as being directed to 
non-statutory subject matter. 

All the dependent claims of said independent claims (i.e., claims 61, 69, and 78) 
are also rejected under 35 U.S.C. 1 01 by virtue of their dependency on said 
independent claims. 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as 
set forth in section 102 of this title, if the differences between the subject matter sought to be 
patented and the prior art are such that the subject matter as a whole would have been obvious at 
the time the invention was made to a person having ordinary skill in the art to which said subject 
matter pertains. Patentability shall not be negatived by the manner in which the invention was 
made. 

8. This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
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under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 103(a). 

9. Claim 1 -5, 7-11,12-16,1 8-21 , 31 -35, 37-51 , and 61 -72, 74-77 are rejected under 

35 U.S.C. 103(a) as being unpatentable over Jasinschi et al., (hereinafter "Jasinschi", 
U.S. Patent Application Publication Number 2002/0164151) in view of Narayanaswami 
et al., (hereinafter "Narayana", U.S. Patent Application Publication Number 
2003/0011684). 

As per claim 1 , Jasinschi teaches a method for performing an action (Jasinschi, 
Paragraph 001 1 , i.e., method for analyzing the content of videotaped multimedia 
presentations) and teaches the limitations: 

"accessing recorded information, the recorded information including information 
recorded during a presentation of source information" (Jasinschi, Paragraph 0027, i.e., 
FIG 1. illustrates a block diagram of an exemplary multimedia analysis system 100 for 
analyzing videotaped multimedia signals; and Paragraph 0033, i.e., Controller 130 
must identify the appropriate video images to be used to create a multimedia table 
of contents. An advantageous embodiment of the present invention comprises 
computer software 200 capable of identifying the appropriate video images to be used 
to create a table of contents for the videotaped multimedia material; Note paragraph 

0036 of Jasinschi which recites "a typical lecture presentation accompanied by 
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slides; Particular note that said "slides" are "source information" and said "typical 
lecture presentation" is "presentation of source information"; Also note that said "video 
images" in paragraph 0033 of Jasinschi are "recorded information". Also note paragraph 
0031 of Jasinschi for "the videotaped multimedia material", which also is "record 
information"); 

"comparing the recorded information to a (source) document, the (source) 
document being separate from the recorded information and being determined to 
include information corresponding to at least a portion of the source information 
presented during the presentation" (Jasinschi, Paragraph 0042, In the fourth stage, the 
video clips that are a part of the lecture presentation ("lecture video clips") are 
segmented. The lecture video clips can be segmented by comparing them to the video 
sequences of the presentation slides, to the head-and-shoulder views of the 
lecturer, and to the static images; and Paragraph 0043, i.e., In an alternate 
advantageous embodiment of the present invention, an additional fifth stage of the 
coarse table of contents segmentation may also be performed. In the fifth stage, 
"combination" images are segmented. A "combination" image is an image that contains 
more than one type of image. For example, one type of combination image comprises a 
static image in which a video clip is superimposed on a portion of the static image. A 
second type of combination image comprises a video clip in which a static image is 
superimposed on a portion of the video clip. A third type of combination image 
comprises a video clip in which a presentation slide is superimposed on a portion of the 
video clip. Other types of combination images are also possible. If no combination 
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images are present, then the fifth stage of the coarse table of contents segmentation is 
not necessary); 

"determining whether a portion of the (source) document corresponds to a 
portion of the recorded information, such that a criterion is satisfied" (Jasinschi, 
Paragraph 0042-0043; "a criterion" here is the similarity between the lecture 
presentation (lecture video clips) and either one of the following: the video sequences 
of the presentation slides, , the head-shoulder views of the presenter, and the static 
images ); 

"performing an action when the criterion is satisfied, the action performed being 
associated with the portion of the recorded information" (Jasinschi, Paragraph 0045, 
i.e., In particular, after the four stages of the coarse table of contents segmentation 
have been performed, the video boundaries between the four sets of images must 
be accurately determined. That is, the video boundaries between the presentation 
slides, the head-and-shoulder views of the lecturer, the static images, and the lecture 
video clips, must be accurately located); 

"sending a result of the action to at least one device" (Jasinschi, Paragraph 0059, 
i.e., After index module 170 has completed its operations, controller 130 stores the 
resulting table of contents in a table of contents storage location 260 in memory unit 
120). 

Jasinschi does explicitly teach the limitation: "comparing a source document, the 
source document being separate from the recorded information and being determined 
to include information corresponding to at least a portion of the source information 
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(during the information)" and "performing a determined action when the criterion is 
satisfied". Note that Jasinschi teaches comparing documents (i.e., comparing recorded 
documents) of a presentation. 

On the other hand, Narayana teaches the limitation: 

"comparing a source document, the source document being separate from the 
recorded information and being determined to include information corresponding to at 
least a portion of the source information (during the information)" (Narayana, Paragraph 
0048, i.e., It is to be appreciated that image verification processing can also be 
performed with the watermarker processor 134. It is to further appreciated that image 
verification processing may also be performed by the remote server in which the image 
archive 210 and the key archive 212 are located. The watermarker processor 134 
includes a stamping information extractor for receiving a stamped image from the 
archive 210 and the corresponding verification key of the stamped image from the 
secured storage of the keys 212. The stamped source image and corresponding 
verification key are processed by the stamping information extractor module 214 
wherein the stamping information embedded on the retrieved stamped image is 
extracted. The extracted stamping information 216 and the original stamping 
information 202 (the recorded camera parameter corresponds to the source 
image) are provided to a comparator module 218, which compares the extracted 
stamping information with the originally recorded parameters. The result of the 
verification is then provided to a confirmation/warning module 220 to either confirm the 
authenticity of the image (assuming there is a match between the extracted data and 
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the recorded data) or to warn the user of potential fraud and to take appropriate 
measures (assuming that there is no match between the extracted data and the 
recorded data). Assuming the verification process is performed in the server system at a 
remote location, such actions may include alerting the system administration of potential 
abuse as well as restricting the access of images whose content integrity is under 
investigation ) and 

"performing a determined action when the criterion is satisfied" (Narayana, 
Paragraph 0048, i.e., The result of the verification is then provided to a 
confirmation/warning module 220 to either confirm the authenticity of the image 
(assuming there is a match between the extracted data and the recorded data) or to 
warn the user of potential fraud and to take appropriate measures ). 

At the time the invention was made, it would have been obvious to person of 
ordinary skill in the art to combine the method of Jasinschi, which teaches comparing 
videotaped presentations to source presentations, with the method of Narayana, which 
also compares recorded information to source presentations and performs an action 
when a criteria is met, so that the combined method would comprise comparing 
recorded information to source presentations and perform a determined action when a 
criteria of comparison is met. One would have been motivated to confirm the 
authenticity of the recorded information (Narayana Paragraph 0048). 



As per claim 2, Jasinschi in view of Narayana teaches the limitation: 
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"wherein the information in the recorded information comprises an image of 
information outputted from the source document" (Jasinschi, Paragraph 0042-0043, i.e., 
In the fourth stage, the video clips that are a part of the lecture presentation ("lecture 
video clips") are segmented. The lecture video clips can be segmented by comparing 
them to the video sequences of the presentation slides, to the head-and-shoulder 
views of the lecturer, and to the static images). 

As per claim 3, Jasinschi in view of Narayana teaches the limitation:: 
"wherein determining the source document comprises comparing an image in the 
source document with the image of information outputted from the source document to 
determine if the image in the source document matches the image of information 
outputted from the source document" (Jasinschi, Paragraph 0042, In the fourth stage, 
the video clips that are a part of the lecture presentation ("lecture video clips") are 
segmented. The lecture video clips can be segmented by comparing them to the video 
sequences of the presentation slides, to the head-and-shoulder views of the 
lecturer, and to the static images; and Paragraph 0043, i.e., In an alternate 
advantageous embodiment of the present invention, an additional fifth stage of the 
coarse table of contents segmentation may also be performed. In the fifth stage, 
"combination" images are segmented. A "combination" image is an image that contains 
more than one type of image. For example, one type of combination image comprises a 
static image in which a video clip is superimposed on a portion of the static image. A 
second type of combination image comprises a video clip in which a static image is 
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superimposed on a portion of the video clip. A third type of combination image 
comprises a video clip in which a presentation slide is superimposed on a portion of the 
video clip. Other types of combination images are also possible. If no combination 
images are present, then the fifth stage of the coarse table of contents segmentation is 
not necessary). 

As per claim 4, Jasinschi in view of Narayana teaches the limitation: 
"wherein the information from the source document comprises an image" 
(Jasinschi, Paragraph 0042-0043). 

As per claim 5, Jasinschi in view of Narayana teaches the limitation: 
"wherein performing the action comprises performing the action using the image" 
(Jasinschi, Paragraph 0042-0043). 

As per claim 7, Jasinschi in view of Narayana teaches the limitation: 
"wherein determining if the criterion is satisfied comprises: associating 
information from the recorded information with the information in the source document; 
and associating the information in the source document with information for the 
criterion" ( Jasinschi in view of Narayana, particularly Jasinschi, Figure 4, i.e., TIME, 
TABLE OF CONTENTS, PRESENTATION SLIDES, and Paragraph 0030, i.e., 
Controller 130 creates a table of contents that displays information that summarizes the 
content of the videotaped multimedia material. The table of contents generally 
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comprises a combination of video signals, audio signals, and text signals. The table of 
contents is capable of displaying (1) text, and (2) still video images comprising a single 
video frame, and (3) moving video images (referred to as a video "clip" or a video 
"segment") comprising a series of video frames, and (4) text transcribed from audio 
signals, and (5) any combination thereof). 

As per claim 8, Jasinschi in view of Narayana teaches the limitation: 
"wherein information for the criterion and action associated with the criterion is 
associated with the source document" (Jasinschi in view of Narayana, Particularly 
Jasinschi, Figure 4 and Jasinschi, Figure 4, i.e., TIME, TABLE OF CONTENTS, 
PRESENTATION SLIDES, and Paragraph 0030, i.e., Controller 130 creates a table of 
contents that displays information that summarizes the content of the videotaped 
multimedia material. The table of contents generally comprises a combination of video 
signals, audio signals, and text signals. The table of contents is capable of displaying 
(1) text, and (2) still video images comprising a single video frame, and (3) moving video 
images (referred to as a video "clip" or a video "segment") comprising a series of video 
frames, and (4) text transcribed from audio signals, and (5) any combination thereof) 

As per claim 9, Jasinschi in view of Narayana teaches the limitation: 
"wherein the information associated with the source document is embedded in 
the source document" (Jasinschi, Paragraph 0030, i.e. text). 
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As per claim 10, Jasinschi in view of Narayana teaches the limitation: 
"wherein the recorded information comprises information identifying the 
information in the source document that has been outputted" (Jasinschi, Figure 4). 

As per claim 1 1 , Jasinschi in view of Narayana teaches the limitation: 
"wherein the recorded information comprises an identifier, wherein the identifier 
is used to determine the information in the source document" (Jasinschi, Figure 4, i.e., 
TIME, TABLE OF CONTENTS, PRESENTATION SLIDES, and Paragraph 0030). 

Claims 12, 13, 14, 15, 16, 18, 19, 20, and 21 are rejected on the same basis as 
claims 1, 2, 4, 3, 5, 8, 9, 10, and 11 respectively. 

Claim 31, 32, 33, 34, 35, 37, 38, 39, 40, and 41 are rejected on the same basis 
as claim 1, 2, 3, 4, 5, 7, 8, 9, 10, and 11 respectively. 

Claims 42, 43, 44, 45, 46, 47, 48, 49, 50, and 51 are rejected on the same basis 
as claims 12, 13, 14, 15, 16, 17, 18, 19, 20,and 21 respectively. 

Claims 61 , 62, 63, 64, 65, 66, 67, and 68 are rejected on the same basis as 
claims 1, 2, 3, 7, 8, 9, 10, and 11 respectively. 

Claims 69, 70, 71 , 72, 74, 75, 76, and 77 are rejected on the same basis as 
claims 12, 13, 14, 15, 18, 19, 20, and 21 respectively. 
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1 0. Claims 6, 1 7, 36, and 73 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Jasinschi in view of Narayana and further view of Boegelund et al., 
(hereinafter "Boegelund", U.S. Patent Application Publication Number 2003/0101043). 

Referring to claim 6, Jasinschi in view of Narayana does not explicitly the 
limitation: "wherein performing the action comprises communicating a translated image 
to a device". 

On the other hand, Boegelund teaches the limitation: 

"wherein performing the action comprises communicating a translated image to a 
device" (Boegelund, Paragraph 0042 and Figure 4, i.e. "the text is then translated to the 
new language" and Paragraph 0047). Boegelund teaches a method and system for 
translating slide presentations into different languages, wherein texts in presentation 
slides are translated from one language to another and displayed (Boegelund et al., 
Paragraph 0042 and Figure 4, i.e. "the text is then translated to the new language." and 
Paragraph 0047). 

At the time the invention was made, it would have been obvious to a person of 
ordinary skill in the to combine the method and system for translating presentation 
slides from one language to another as taught by Boegelund with the system and 
method of Jasinschi in view of Narayana so that the combined method and system 
would constitute the method of claim 4, wherein performing the action comprises 
communicating a translated image of the image to a device (Boegelund, Paragraph 
0042 and 0047 and Lin, Paragraph 0029-0031, i.e. "when the multimedia data object is 
replayed using a computer controllable display screen and an audio device "). One 
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would have been motivated to do so in order to "have a method that can translate 
presentation slide information from one language to a second language in an efficient 
and accurate and cost-effective manner" (Boegelund, Paragraph 0014). 

Claim 17 is rejected on the same basis as claim 6. 

Claim 36 and 73 are rejected on the same basis as claim 6. 

1 1 . Claims 22-29, 52-59, and 78-82 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Jasinschi in view of Narayana and further view of Boegelund and 
further in view of Lin (U.S. Patent Application Publication Number 2004/0205477). 

As per claim 22, Jasinschi in view of Narayana and further in view of Boegelund 
teaches the limitations: 

"accessing recorded information, the recorded information including information 
recorded during a presentation of source information from at least one source document 
separate from the recorded information" (Jasinschi, Paragraph 0027, i.e., FIG 1. 
illustrates a block diagram of an exemplary multimedia analysis system 100 for 
analyzing videotaped multimedia signals; and Paragraph 0033, i.e., Controller 130 
must identify the appropriate video images to be used to create a multimedia table 
of contents. An advantageous embodiment of the present invention comprises 
computer software 200 capable of identifying the appropriate video images to be used 
to create a table of contents for the videotaped multimedia material); 



Application/Control Number: 10/661,052 Page 15 

Art Unit: 2162 

"comparing a source document slide in the at least one source document to an 
image containing in the recorded information, a criteria being satisfied if the source 
document slide corresponds to the image" (Narayana, Paragraph 0048 in view of 
Jasinschi, Paragraph 0042, In the fourth stage, the video clips that are a part of the 
lecture presentation ("lecture video clips") are segmented. The lecture video clips can 
be segmented by comparing them to the video sequences of the presentation slides, 
to the head-and-shoulder views of the lecturer, and to the static images; and 
Paragraph 0043); and 

"communicating a translated slide to a device when the criteria is satisfied, the 
translated slide including a translation of at least a portion of the source document 
slide," (Boegelund et al., Paragraph 0042 and Figure 4, i.e. "the text is then translated to 
the new language", and Paragraph 0047). 

Jasinschi in view of Narayana and further in view of Boegelund does not teach 
the limitation: "whereby the device is operable to display the translated slide while 
accessing the portion of the accessed recorded information". 

On the other hand Lin teaches the limitation: 

"whereby the device is operable to display the translated slide while accessing 
the portion of the accessed recorded information" (Lin, Paragraph 0028-0028, .i.e. 
"Synchronization of the overlaid replayable bitstreams..." ; and Paragraph 0029-0031, 
i.e. "when the multimedia data object is replayed using a computer controllable display 
screen and an audio device "). 
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At the time the invention was made, it would have been obvious to a person of 
ordinary skill in the art to add the feature of displaying a slide while accessing the 
portion of the accessed recorded information to the method of Jasinschi in view of 
Narayana and further in view of Boegelund so that the resultant method would display 
translated slides while accessing the portion of the accessed recorded information. One 
would have been motivated to do so in order to produce a replayable recording of the 
real-time presentation (Lin, Paragraph 0006). 

Referring to claim 23, Jasinschi in view of Narayana and further in view of 
Boegelund and further in view of Lin as applied above with regard to claim 22 discloses 
the invention as claimed. Jasinschi in view of Narayana and further in view of 
Boegelund is directed to the method of claim 22, "wherein determining the translated 
slide comprises translating text of the source document slide to generate the translated 
slide" (Boegelund et al., Paragraph 0042 and Figure 4, i.e. "the text is then translated to 
the new language." and Lin, Paragraph 0028-0028, .i.e. "Synchronization of the overlaid 
replayable bitstreams..."). 

Referring to claim 24, Lin in view of Boegelund et al. as applied above with 
regard to claim 22 discloses the invention as claimed. Lin in view of Boegelund is 
directed the method of claim 22, wherein determining the translated slide comprises: 

"determining a storage location of the translated slide" (Boegelund, Paragraph 
0048, i.e. " storage and retrievaf'); and 
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"retrieving the translated slide from the storage location" (Boegelund, Paragraph 
0048, i.e. " storage and retrievar). 

Referring to claim 25, Lin in view of Boegelund et al. as applied above with 
regard to claim 22 discloses the invention as claimed. Lin in view of Boegelund et al. is 
directed the method of claim 22, "wherein communicating the translated slide to a 
device comprises causing the translated slide to be displayed on the device" (Lin, 
Paragraph 0029-0031 , i.e. "when the multimedia data object is replayed using a 
computer controllable display screen and an audio device "). 

Referring to claim 26, Lin in view of Boegelund et al. as applied above with 
regard to claim 22 discloses the invention as claimed. Lin in view of Boegelund et al. is 
directed the method of claim 22, "wherein communicating the translated slide to a 
device comprises storing the translated slide" (Lin, Paragraph 0029-0031, i.e. "when the 
multimedia data object is replayed using a computer controllable display screen and an 
audio device "). 

Referring to claim 27, Lin in view of Boegelund et al. as applied above with 
regard to claim 22 discloses the invention as claimed. Lin in view of Boegelund et al. is 
directed the method of claim 22, "wherein the recorded information comprises an image 
of an outputted source document slide" (Lin, Paragraph 0025, 0027, 0033 and 0035). 
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Referring to claim 28, Lin in view of Boegelund et al. as applied above with 
regard to claim 27 discloses the invention as claimed. Lin in view of Boegelund is 
directed the method of claim 27, "wherein determining the source document slide 
comprises comparing the image of the outputted source document slide to information 
in the source document slide to determine if the image of the outputted source 
document matches the information in the source document slide" (Lin, Paragraph 0028, 
i.e. "For example, Fig. 1 D shows a replayed slide corresponding to the captured image 
of the real-time slide presentation"). 

Referring to claim 29, Lin in view of Boegelund et al. as applied above with 
regard to claim 27 discloses the invention as claimed. Lin in view of Boegelund is 
directed the method of claim 27, "wherein the recorded information comprises 
information indicating that the source document slide in the source document has been 
outputted" (Lin, Paragraph 0025-0028 and 0033-0036). 

Claims 52, 53, 54, 55, 56, 57, 58, and 59 are rejected on the same basis as 
claims 22, 23, 24, 25, 26, 27, 28, and 29 respectively. 

Claims 78, 79, 80, 81 , and 82 are rejected on the same basis as claims 22, 24, 
27, 28, and 29 respectively. 
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12. Claims 30, 60 and 83 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Jasinschi in view of Narayana and further view of Boegelund and further in view of 
Lin and further in view of Smith (U.S. Patent Application Publication Number 
2004/0205601). 

Referring to claim 30, Jasinschi in view of Narayana and further view of 
Boegelund and further in view of Lin as applied to claim 27 above does not explicitly 
recite that slide number is used to determine the source document slide. However, 
Smith teaches a method and system for identifying, classifying, extracting and resolving 
hidden data in slides, wherein slide numbers are used to determine slides in a source 
document (Smith Paragraph 0073). 

At the time the invention was made, it would have been obvious to a person of 
ordinary skill in the art to add the feature of employing slide number to 
identify/determine slides in a source document as taught by Smith to the method and 
system of Jasinschi in view of Narayana and further view of Boegelund and further in 
view of Lin so that, in the resultant method and system, the recorded information would 
comprise a slide number, wherein the slide number is used to determine the source 
document slide. One would have been motivated to do so simply because slide 
numbers are used in the art to identify slides and that has been a well-known method in 
the art. 

Claim 60 is rejected on the same basis as claim 30. 
Claim 83 is rejected on the same basis as claim 30. 
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Conclusion 

13. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure as follows. 

U.S. Patent Application Publication Number 20030191633 (Berger) 

14. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dennis Myint whose telephone number is (571) 272- 
5629. The examiner can normally be reached on 8:30AM-5:30PM Monday-Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Breene can be reached on (571) 272-4107. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 

/Cam Y Truong/ 

Primary Examiner, Art Unit 2162 Dennis Myint 

Examiner 
AU-2162 



